Evolution of title of long ACL papers. Each column shows terms distinctive a year. Size indicates frequency; order characteristicness.

201720182019202020212022
presentneuralartbertlanguage modelsexisting
wordnetworkneuralenglishgraphtasks
featureswordspapermodelingdatasetspre - trained
neuralinformationdatasetgraphretrievallanguages
algorithmstateshow thatmethodtraininglanguage
learningsentimentusedtransformerbasedlarge
useintroduceberthumangenerationplms
problemparsingmethodsperformancespecificallycode
sequencelearningapproachnatural languagetranslationevaluation
artarchitecturecontexttrainingtextspeech